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Abstract 


Suppose  a  measure  y  dominates  a  measure  n  in  the  ordering  induced 
by  the  excessive  functions  of  a  transient  Markov  process.  Rost  shows 
than  n  can  be  represented  as  the  distribution  of  the  process  stopped 
at  a  randomized  optional  time  and  started  with  initial  distribution 
y.  In  this  paper  we  introduce  the  shift  operator  to  the  class  of 
randomized  optional  times,  inducing  the  class  of  randomized  quasi¬ 
terminal  times  and  that  of  randomized  terminal  times.  We  analyze  the 
algebraic  properties  of  these  classes  and  obtain  some  compactness 
results  for  the  class  of  randomized  quasi- terminal  times.  Some  appli¬ 
cations,  including  remplissage  by  hitting  times,  are  presented. 


1.  Introduction.  Suppose  we  have  a  Markov  process  X  on  a  suitable 
state  space  S  with  Borel  0  -  algebra  S.  If  A  is  a  measurable  subset 
of  S  and  p  an  initial  distribution  for  the  process,  then  the  p  -  hitting 
distribution  of  A  is  defined  by  starting  the  process  with  distribution 
p  and  running  it  until  it  hits  A  for  the  first  time.  This  probabilistic 
construct  has  close  links  with  the  balayage  of  measures,  a  potential  - 
theoretic  construct,  and  plays  a  central  role  in  probabilistic  potential 
theory.  (The  geometric  meaning  of  these  concepts  becomes  clearer  when 
A  is  the  boundary  of  an  open  connected  set  G  and  p  is  required  to  have 
support  in  G . ) 

In  earlier  work  ([7],  [8],  [9])  the  authors  investigated  the 
reverse  of  this  construction,  the  so-called  inverse  balayage  problem. 

One  is  given  a  distribution  ri  on  A  and  tries  to  characterize  the  family 
of  measures  whose  balayage  onto  A  is  I)-  For  finite  state  Markov  chains 
rather  straightforward  techniques  yield  a  complete  description  of  the 
convex  set  of  measures  which  balayage  onto  the  given  T).  The  same  kind 
of  analysis  works  for  a  diffusion  on  an  interval,  but  more  sophisticated 
techniques  are  required  for  general  state  spaces. 

The  questions  arising  in  the  inverse  balayage  problem  are  closely 
connected  with  Skorokhod's  problem  and  work  of  Rost.  Rost  [12]  shows 
that  if  p  dominates  n  in  a  partial  ordering  defined  by  the  excessive 
functions  for  X,  then  h  can  be  realized  as  the  distribution  of  the 
process  started  with  initial  distribution  p  and  stopped  using  a  random¬ 
ized  optional  time  {Ty  :  0  <  u  <  l}  : 

n(dx)  =  [x  (T  Jpdxldu. 


(1.1) 


One  interpretation  of  (1.1)  is  that  r|  is  represented  as  a  sort  of 

convex  combination  of  optional  times,  and  this  motivates  the  definition 

of  a  convexity  structu  e  on  the  space  of  randomized  optional  times. 

The  inverse  balayage  problem  can  be  viewed  as  a  search  for  measures 

P  which  satisfy  (1.1)  with  T  =  T,  for  all  0  <  u  <  1. 

u  A 

Another  related  result  is  that  of  Heath  [6] .  Drawing  heavily  on 

potential -theoretic  work  of  Mokobodski  and  Watanabe  [16) ,  Heath  shows 

that  for  discrete-time  processes  the  randomized  times  in  (1.1)  can 

be  chosen  to  be  "nested"  terminal  times:  for  each  u,  T  is  a  terminal 

u 

time  and  u  <  v  implies  T^  <  Tv  a.s.  If  one  specializes  to  finite 
state  Markov  chains,  it  is  easy  to  obtain  that  result  using  a  less 
sophisticated  approach  -  we  call  it  remplissage  via  hitting  times  and 
present  details  in  Section  5  as  an  example  of  the  construction  of  a 
randomized  terminal  time. 

In  [1]  Baxter  and  Chacon  studied  compactness  properties  of 
randomized  times  in  a  suitable  topology,  and  Falkner  [3]  remarked  on 
the  use  of  this  compactness  to  obtain  (1.1).  (Several  of  Falkner's 
related  papers  are  listed  in  the  references.) 

Motivated  by  all  of  these  ideas  and  results,  we  examine  here 
structural  properties  of  randomized  times  in  the  presence  of  the  shift 
operator.  Of  special  interest  is  the  class  of  randomized  quasi -terminal 
times,  which  lies  between  randomized  optional  times  and  randomized 
terminal  times.  This  class  is  motivated  by  the  interaction  between 
the  shift  operator  and  basic  algebraic  operations,  and  the  requisite 
definitions  are  given  in  Section  2. 


In  Section  3  we  discuss  algebraic  consequences  of  the  definitions, 
while  Section  4  is  devoted  to  sequential  compactness  of  quasi-terminal 
times.  Technical  questions  of  null  sets  arise  and  a  complete  generali¬ 
zation  of  Baxter  and  Chacon's  results  to  quasi-terminal  times  does  not 
seem  possible  without  additional  hypotheses.  In  Section  5  r e  illustrate 
some  of  these  ideas,  including  applications  of  sequential  compactness  results 
to  Markov  chains  and  to  Rost's  original  proof  of  (1.1)  for  Markov  processes. 
2.  Randomized  times  and  random  measures.  The  motivation  for  this 
work  comes  from  Markov  processes,  and  we  record  some  of  the  basic 
definitions.  Let  S  denote  the  Borel  0  -  algebra  on  a  state  space 
S  assumed  to  be  Lusin  -  that  is,  S  is  homeomorphic  to  a  Borel  subset 
of  a  compact  topological  space.  Let  X  =  (SI,  F,  F^,  Xfc,  0^,  PX)  be  a 
Markov  process  on  S.  We  assume  that  the  associated  semigroup  P^f(x)  = 

x 

P  [f(xt>l  maps  Borel  functions  into  Borel  functions  and  that  the 

x 

process  is  right-continuous.  (We  follow  the  convention  of  using  P 
to  denote  both  a  probability  and  an  expectation.) 

Our  immediate  concern  is  less  the  Markov  process  itself  than  the 
filtration  (F^  :  t  >  0) ,  which  we  assume  to  be  right-continuous  and  the 
usual  completion  of  the  separable  a  -  algebra 

(2.1)  F°  =  a{x  :  s  <  t}. 

t  s  - 

One  way  of  introducing  the  randomization  is  via  the  product  space 

(2.2)  ft  =  fi  x  (0,  «°]  ,  F  =  F  x  B, 

where  8  denotes  the  Borel  sets  on  [0,  °°] .  The  first  class  of  randomized 
times  with  which  we  are  concerned  is  given,  for  example,  in  Baxter 
and  Chacon  (1);  we  use  a  slight  variation  of  their  definition. 
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(2.3)  Definition.  is  the  set  of  mappings  T  :  £2  -*■  [0,  °°]  with  the 

properties 

(a)  T  ( . ,  u)  is  optional  for  each  u  -  that  is, 

(to:  T  (<o ,  u)  <  t}  6  F  for  each  t  >  0. 

(b)  T(to,.)  is  nondecreasing  and  left-continuous  for  each  to. 

(we  define  T((o,  0)  =  T(co,  0+) 

(c)  uT(W)  s  inf  {u  :  T(co,  u)  =  °°}  <  00 . 

The  set  of  random  measures  corresponding  to  Tq  coincides  with  the 
following  class. 

(2.4)  Definition.  Aq  is  the  set  of  random  measures  A  on  [0,  °°]  with 
the  properties 

(a)  A ( *,  s)  6  F  ,  all  s  €  [0,  °°] ,  where  A  (to,  s)  =  A((0,  [0,  s) ) . 

s 

(b)  A(u),  s)  is  right-continuous  in  s. 

(c)  A (u),  [0,  °°) )  <  »  . 

The  relationship  between  TQ  and  Aq  is  defined  in  the  usual  manner 
given  T  in  define  A^  by 

(2.5)  A^tu),  s)  =  sup{u  :  T(l0,  u)  <  s} . 

Then  A^  is  nondecreasing,  and  it  is  easy  to  check  that 

(2.6)  {(0  :  At(U),  s)  >  u}  =  {to  :  T((0,  u)  <  s}. 

Routine  computations  show  that  A^  6  A  .  In  fact,  the  mapping 
A^  defined  by 

(2.7)  M1(T)  =  At 
has  the  following  properties. 


(2.8)  Lemma.  The  mapping  is  one-to-one  and  onto,  and  its  inverse 
map  M  :  A  -*•  T  is  given  by  M  (A)  =  T  ,  where 

2  U  U  2  Pi. 

(2.9)  T  (U),  u)  =  inf{s  :  A(u>,  s)  >  u). 

A 

We  now  bring  in  shift  operators  using  the  "big  shift".  For  T  £ 
and  s  >  0  define 

(2.10a)  0  T(a),  u)  =  s  +  T(8  u>,  u)  ; 

s  s 

(2.10b)  0  A (u),  t)  =  A (9  Oi,  t-s)l(s  <  t  <  °°)  . 

s  s  -  - 

The  definition  of  0  on  random  measures  seems  to  have  been  introduced  by 

s 

Sharpe  (see  [2]  for  example) ,  and  0  T  appears  in  one  guise  or  another 

s 

throughout  the  literature,  usually  in  the  simpler  form  of  Tg.  (Note  that 
we  should  really  define  two  shifts,  since  one  applies  to  random  times 
and  the  other  to  random  measures.) 

Next  we  define  subclasses  of  Aq  and  Tq  suggested  by  the  shift  operator 

and  the  applications  mentioned  in  the  introduction. 

(2.11)  Definition.  Let 

T.  =  (T  (  T  :  for  all  0  <  s  <  °°,  0  T  £  T  and 
i  u  -sO 

for  all  0  <  r  <  s  and  0  <  u,  0  T(w,  u)  <  0  T(w,  u)}; 

-  -  -  r  -  s 

A  =  (A  €  A  :  for  all  0<s<®,  0A6A.  and  for 
x  o  -  s  0 

all  0<r<s,  0<t,  0  A  (u) ,  t)  >  0  A(u>,  t)  } ; 

“  _  r  -  s 

T 2  -  (T  €  T  :  for  all  0  <  s  <  °°,  s  <  T(u>,  u) 
implies  0sT(w,  u)  =  T(u>,  u)}; 

A2  =  {A  €  A^  :  A(u>,  s)  <  A  (w,  t)  implies  Q^Ato),  t)  =  A(w,  t) } . 
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These  definitions  can  be  weakened  by  allowing  inequalities  to  fail 

on  null  sets  depending  on  the  time  parameters.  Thus  A^denotes  the  set 

of  A  £  A„  such  that  0  A  £  A„  for  all  s  >  0  and  such  that  for  0  <  r  <  s 
0  s  0  - 

there  is  a  null  set  depending  on  r  and  s  off  which  G  A(w,  t)  >  Q  A(u),  t) 

r  -  s 

for  all  t.  Similarly,  T^  shall  denote  the  analogous  class  of  randomized 
times.  The  need  for  these  classes  arises  in  Section  5,  where  we  apply 
our  results  to  the  representation  theorem  of  Rost  [12] ,  and  only  the  sets 
A^  and  are  available 

A  random  time  in  has  the  property  that  T(*,  u)  is  a  terminal  time 
for  all  u.  One  can  construct  such  a  time  by  defining  T(-,  u)  as  the  hitting 
time  of  a  Borel  set  ,  where  0  <  u  <  v  <  1  implies  .  (An  example 

of  how  such  times  arise  in  practice  appears  in  Section  5.)  Times  in’T^ 
shall  be  referred  to  as  randomized  terminal  times ,  while  those  in  the 
intermediate  class  T ^  are  called  randomized  quasi-terminal  times,  since 
the  defining  property  comprises  part  of  the  definition  of  a  terminal  time. 

We  single  out  those  times  in  T  which  correspond  to  ordinary  random 
times. 

(2.12)  Definition.  A  time  T  in  T  is  called  natural  if  T(U),  u)  =  T(w) 
for  all  u  <  u^.  Correspondingly,  we  call  a  natural  T  a  quasi- terminal 
time  or  a  terminal  time  if  it  is  also  in  or  T^,  respectively. 

We  conclude  these  definitions  by  showing  T  and  A^  are  related  in 
the  same  way  that  T ^  and  A^  are  related  and  also  that  the  shift  operaters 
commute  with  and  M 2-  We  leave  it  to  the  reader  to  check  that  the  same 
results  apply  to  and  A^. 

(2.13)  Proposition.  For  i  =  1,  2,  and  restricted  to  T\  and  A^ 


respectively  are  inverses.  Furthermore,  for  all  s  >  0 


(2.14) 


0sM2  -  M20s  .  0SM1  -  MjO^ 

Proof:  Suppose  T  =  M2 (A)  with  A  in  A^.  Then  with  u  >  0  and  r  <  s 

(2.15) 

=  s  +  inf {t  :  A (0  t)  >  u} 


0  T (to ,  u)  =  s  +  T(0  W,  u) 
s  S 


=  s  +  inf {t  :  0  A(W,  s+t)  >  u} 

S  “ 


-  s  +  inf{t  :  0  A(oj,  s+t)  >  u) 
r 

=  r  +  inf {t  >  s-r  :  AfG^oi,  t)  >  u> 

>  0  T(u),  u)  . 
r 

Line  three  above  translates  to  0^  (A)  =  M2  (0gA)  ,  and  the  entire  sequence  gives 
T  in  f  .  Now  set  r=C .  If  tQ  =  T(w,  u)  >  s,  then  for  s+t^  <  tQ  <  s+t^  we  have 

A(0),  s+t^)  <  u  <  A(W,  s+t2)  . 

Hence,  if  A  £  ,  A(o>,  s+t,,)  =  0gA(W,  s+t2)  and  there  is  equality  in  line 

four  of  (2.15).  Further,  the  infimum  implicit  in  the  last  line  is  over 
t  >  s,  so  that  T  must  be  in  T 2« 

For  the  other  direction  we  have  an  analogous  argument.  Suppose  r<s<t 

and  T(  Y  Then  with  A  =  M^T), 

0  A (cu ,  t)  =  A(9  0),  t-s) 
s  s 

=  sup{u  :  T (0  0),  u)  <  t-s> 
s  ~ 

=  sup(u  :  0  T(w,  u)  <  t} 
s  - 

<  sup{u  :  T(W,  u)  <  t} 


=  supiu  :  T (0^uj ,  u)  <  t-r}  =  O^A(u),  t) , 
confirming  ©^(T)  =  M1(0gT)  and  A  in  If  in  addition  T  (  ^  and 

A (oi,  s)  =  uQ  <  u1  =  A (u>,  t),  then  T(w,  u)  >  s  for  u  >  uQ  ,  which  gives 


H 


0  T(U),  u)  equal  to  T(uj,  u)  .  If  r  is  set  equal  to  zero  it  follows  that  the 
suprema  above  can  be  restricted  to  u  >  uQ  and  that  we  have  equality  in  the 
fourth  line/ completing  the  proof.  [  j 

3.  Algebraic  structure  on  A^  and  T^.  Suppose  X  is  two-dimensional  Brownian 
motion  absorbed  at  the  circle  of  radius  two.  If  y  denotes  the  point  mass 
at  the  origin  and  f)  a  probability  measure  with  half  of  its  mass  at  the 
origin  and  half  uniformly  distributed  on  the  unit  circle,  then  y  dominates 
r)  in  the  ordering  induced  by  the  excessive  functions.  Furthermore,  n  can 
be  realized  as  the  process  with  initial  distribution  U  stopped  “half  the 
time"  at  zero  and  otherwise  at  the  unit  circle.  If  is  the  hitting  time 
of  (0,  0)  and  is  the  hitting  time  of  the  unit  circle,  then  one  could 
think  of  ti  as  the  process  with  initial  distribution  y  stopped  at  "  + 


We  make  this  approach  rigorous  by  defining  an  appropriate  algebraic 
structure  on  using  A^  and  the  mapping  .  Before  proceeding  let  us  note 
that  the  intuition  behind  these  ideas  is  not  new;  Meyer,  for  example,  alludes  to 
order  and  convexity  properties  in  his  discussion  [11]  of  Baxter  and  Chacon's  work. 

Addition  and  positive  scalar  multiplication  on  AQ  are  defined  in  terms 
of  the  distribution  functions. 

(3.1)  Definition.  For  A^  ,  A^  6  A^  and  c  >  0  let 
(A  +  A2)  (u),  t)  =  A  (U),  t)  +  A2(w,  t); 

(cA^)  (0),  t)  =  c  •  A  (W,  t)  . 

Since  the  properties  characterizing  A^  are  satisfied  for  both  A^  +  A2  and 
cA^  ,  Aq  is  closed  under  these  operations.  It  is  easy  to  check  that  A^ 
is  also  closed  under  both  operations  and  that  A^  is  closed  under  scalar 
multiplication.  (The  latter  assertion  follows  from  the  use  of  c  •  0  A  = 


0  (c A)  . ) 
s 
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However,  need  not  be  closed  under  addition.  For  example  if 

A  (<«>,  t)  =  1  (T±  (OJ)  <  t  <  «o)  ,  i  =  1,2, 

where  the  T\  are  finite  terminal  times,  then  the  inequality  A^(u),  s)  < 

A^  (to,  t)  obviously  implies  equality  of  GsA^((jJ,  t)  and  A^(gj,  t)  .  However, 
if 

T,  ((a)  <  s  <  T_  (la)  <  t  <  0  T  (to)  , 

1  2  s  X 

then  (A  +  A2)  (w,  s)  <  (A1  +  A2)  (u>,  t)  ,  but 

0  (A  +  A_)  (U),  t)  =  1  <  2  =  (A,  +  A_)  (W,  t)  . 

S  1  2  12 

The  following  result  summarizes  these  observations. 

(3.2)  Lemma.  The  sets  AQ  and  A^  are  positive  cones  under  addition  and 

positive  scalar  multiplication,  while  A 2  is  closed  under  positive  scalar 

multiplication.  Furthermore,  if  algebraic  operations  on  T\  are  defined  by 

T  +  T2  s  m2(A1  +  A2J 

and 

c  •  T  =  M2 (cAx ) , 

then  Tq  and  T ^  are  positive  cones,  and  T 2  is  closed  under  scalar  multiplication. 

Proof .  The  definitions  of  multiplication  and  addition  on  Aq  show  these 
operations  satisfy  the  required  algebraic  properties.  Moreover,  these 
properties  are  preserved  under  the  bijection  M2  ,  so  that  T  is  a  positive 
cone;  for  example, 

(a  •  T  )  +  (a  ■  TL)  =  M2(aAQ  +  aA^  =  a  • (TQ  +  Tx> . 

Since  M2  maps  A^  onto  ,  we  easily  deduce  that  is  a  positive 
cone.  Note  that  part  of  the  verification  uses  commutativity  of  scalar 
multiplication  with  the  big  shift: 
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0  (cT)  =  0  (m  (cA))  =  M  (0  (cA)) 


=  M  (c0  A)  =  cM_ (0  A)  =  c  •  0  A. 
2  s  2  s  s 


We  omit  the  remaining  details.  [] 

The  effect  on  T  of  scalar  multiplication  is  to  rescale  the  randomizing 
parameter : 

cT(u),  u)  =  inf{t  :  cA(U),  t)  >  u} 

=  inf{t  :  A(U),  t)  >  u/c}  =  T(u>,  u/c)  . 

Addition  has  the  effect  of  mixing  up  the  values  assumed  by  the  constituent 
times,  an  effect  noted  by  Meyer  [10].  Thus,  for  the  example  preceding 


(3.2) 


(Tf  +  T2>  (u),  u)  =  inf{r  :  A^tU),  r)  +  A2(u),  r)  >  u) 


(0J)  ,  0  <  u  <  1 


T1(0))  +  T2(W)  ,  1  <  u  <  2 


00  ,  2  <  u. 


Order  and  convexity  structures  are  defined  in  the  obvious  way. 

(3.3)  Definition.  A^  <  A2  iff  A^  (U),  t)  <  A^(W,  t)  for  all 

t  Z  0  ;  Tj  t  T2  iff  Ti^“'  u)  1  T2^'  for  a11  u  t  °* 

To  ease  the  exposition  we  assume  we  are  working  on  a  fixed  fl  with  the 
inequalities  holding  for  all  u>.  However,  the  presentation  can  be  easily 
modified  so  that  the  inequalities  are  valid  except  on  a  null  set. 

(3.4)  Definition.  For  A^  ,  A2  in  ,  let 

(A  V  A  )  (W,  t)  5  A  (W,  t)  V  A  (0),  t ); 


(A1  A  A2)  (0),  t)  =  A  (W,  t)  A  A2  (W,  t)  . 


Similarly,  given  T  ,  T2  in  TQ  let 

(T.  *  T  )  (to,  u)  =  (T  (0),  u))  A  (t  (0),  u)}. 
1  V  2  1  V  ^ 
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The  sets  A^  and  have  a  variety  of  lattice  properties,  but  we  will 


content  ourselves  with  stating  only  a  few  explicitly. 


(3.5)  Lemma.  The  sets  and  T  ,  i  =  1  and  2,  are  closed  under 


A  and  V .  In  addition  scalar  multiplication  and  the  shift  operators 
commute  with  A  and  V ,  while 
(3.6) 


A1  +  A2  =  (A1  V  A2*  +  (A1  A  A2} 


T  +  T2  =  (Tx  A  T2)  +  Tx  V  T2) 


Finally, 


(3.7) 

I 

J 

|  V*i 

aV  *VV 

£  W 

\ 

\ 

i  VTi 

A  V  '  VV 

£  "l(T2K 

Proof. 

It  is  easy  to 

check  that  A^  is 

closed  under 

the  first  part  of  (3.6)  holds.  Moreover,  since  0  commutes  with  both 


A  and  V ,  the  same  assertions  hold  for  A^ . 


Now  if  T  =  M2(Ax  V  A2)  ,  then 


T(U),  u)  =  inf{t  :  A^(u),  t)  V  A2  (w,  t)  >  u} 

=  inf{t  :  A^(u),  t)  >  u}  A  inf{t  :  A2  (u>,  t)  >  u} 

=  T  (<*),  u)  A  T2  (0),  u)  . 

Similarly  M2  (A^  A  A2)  =  M2  (A^)  V  M2  ( )  •  This  shows  and  are 
closed  under  A  and  V  and  also  that  the  equations  in  (3.7)  hold. 
Finally,  the  second  part  of  (3.6)  follows  from  (3.7)  and  the  first  part 
of  (3.6).  □ 

The  example  preceding  (3.2)  shows  that  T need  not  be  closed  under 
V  . 


However  we  do  have  a  partial  result. 


(3.8)  Lemma.  A and  are  closed  under  V  and  A  respectively. 

Proof.  Let  and  A2  be  in  A2 .  Suppose  s  <  t  and 

(3.9)  (A  V  A2)  (0),  t)  >  (Ax  V  A2)  (0),  s). 

If  A^(co,  t)  >  Aj.  (cj,  s)  for  i  =  1,  2,  then 

(3.10)  0  (A.  V  A.)  (U),  t)  =  (0  A.  V  G  A  )  (0),  t) 

Sl  2  Si  S  2 

=  0  A  (u>,  t)  V  0  A_(m,  t)  =  (A,  V  A.)  (u),  t). 
s  1  s  2  12 

If  A2(o),  s)  =  A2  (tu,  t)  ,  necessarily  A^  (a),  t)  >  A2(u>,  t)  and 

A^fto,  t)  >  A^fu,  s)  for  (3.9)  to  hold.  This  suffices  for  (3.10) 

as  well,  and  the  assertion  for  follows.  The  assertion  for  then 

follows  using  the  usual  mapping.  [] 

It  is  natural  to  ask  about  convexity  properties,  which  requires 
that  we  use  bases  of  the  positive  cones  described  above.  In  doing  this 
we  impose  a  condition  for  all  0)  -  or  again  for  a  full  set  if  we  use 
the  weaker  definitions  mentioned  above. 

(3.11)  Definition.  For  i  =  0,  1,  2  ,  let 

7\  (i)  «  T  0  (T  :  UT(U))  <  1>; 

A.(l)  =  A  n  (A  :  A (W,  [0,  «>))  <  l}. 

Further,  we  require  natural  times  in  this  context  to  have  uT(w)  =  1. 

It  is  easy  to  check  that  and  M2  ,  restricted  to  (1)  and  A^(l)  , 
remain  inverses  of  one  another.  The  sets  defined  in  (3.11)  are  those 
used  by  Baxter  and  Chacon.  (1). 

The  next  result  identifies  extreme  points. 

(3.12)  Theorem.  For  i  =  0  and  i  =  1  ,  A^(l)  and  T\(l)  are  convex  sets. 
The  extreme  points  of  T^d)  correspond  to  natural  times,  while  those  of 
T^(l)  are  quasi-terminal  times. 


Proof.  The  first  assertion  is  immediate  from  the  definitions.  For  the 

second,  given  a  €  (0,  1)  and  A  6  A^(l),  define  A^  =  a  * (a  A  A^ )  and 

A^  =  max(o,  (1  -  a)  * (A  -  a)).  It  is  easy  to  check  that  A^  and  A^  are 
also  in  A^(l)  and  that  A  =  aA^  +  (1  -  a)A2  .  If  A  is  an  extreme  point, 

A  =  A^  =  A^  .  Thus  if  A (gj,  t)  <  a,  A2(u>,  t)  =  0  =  A(w,  t)  .  If  A(oj,  t)  >  a, 
A^(u),  t)  =  1  =  A(0),  t)  .  Hence  for  each  M  there  is  a  Tq  (cj)  such  that 
A(u),  t)  =  l(T0(io)  <  t  <  00 )  .  (Note  that  TQ  =  00  is  a  possibility  and  also 

that  we  could  have  done  the  foregoing  analysis  on  a  set  of  probability 

one.)  It  is  easy  to  check  that  if 


T(o),  u)  = 


T  (w)  0  <  u  <  1 


u  >  1, 


then  T  is  a  natural  time  if  A  6  A  (1)  and  is  a  quasi-terminal  time  if 
A  €  Ai(l)  .  The  proof  that  natural  and  natural  quasi -terminal  times  are 
extreme  points  is  trivial,  and  details  are  omitted.  [] 

Having  characterized  extreme  points  we  proceed  one  step  further  and 
characterize  edges,  i.e.,  faces  of  dimension  one. 

(3.13)  Proposition.  Let  T.  and  T„  be  extreme  points  of  T  (1).  Then 
- * -  12  0 

T^  and  T2  define  on  edge  iff  one  of  the  times  is  smaller  than  the  other, 
say  <  T2 ,  and  F(T^)  is  trivial. 

Remark.  If  we  are  working  with  respect  to  a  fixed  measure  P^  ,  then  the 
null  sets  should  be  interpreted  with  respect  to  that  measure.  Indeed,  the 
proposition  implies  that  edges  will  exist  only  for  initial  measures  whose 
support  is  at  one  point. 


Proof .  Suppose  T^  and  T2  are  natural,  T^  <  T2  and  F(T^)  is  trivial. 
Suppose  there  exist  random  measures  in  Aq(1)  and  a,b€  (0,1),  such  that 

bB^(u),  t)  +  (1  -  b)B2(w,  t)  =  aA^Uo,  t)  +  (l  -  a)A2(w,  t)  . 
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Since  can  have  a  jump  only  where  A^  or  A^  has  a  jump,  it  follows  that 

for  some  random  variable  C.  ,  we  have  B.  =  C.A  +  (1  -  C.)  A  ;  however 

i  1  1  T1  1  T2 

it  is  straightforward  to  show  that  C.  must  be  F  =  F  -  measurable, 

l  T1  A  T2  T1 

and  hence  constant  a.s.  Consequently  and  T 2  define  an  edge. 

Conversely,  suppose  and  T2  define  an  edge.  Then  going  to  the 
random  measures  we  have 

-f(A  +  A  )  =  -|-[A1  V  A2  +  Ax  A  A2J. 

By  hypothesis  there  then  exists  a  constant  c  so  that 

A1(w,  t)  V  A2(w,  t)  =  cA  (u),  t)  +  (1  -  c)A2(w,  t). 

If  there  is  a  set  with  positive  measure  such  that  <  t  <  T2  ,  then 

1  V  A2«d,  t)  «  1  *  c  +  (1  -  c) A2(w,  t), 

which  implies  the  constant  c  equals  one.  If  T2  <  T^  is  also  possible  on 

a  set  with  positive  measure,  we  obtain  c  equals  zero.  Both  cases  can't 

occur,  and  we  assume  T,  <  T„  . 

1-2 

Now  suppose  F(T1)  is  not  trivial.  Then  there  exists  a  nonconstant 
F(T^)  -measurable  random  variable  C(u>)  with  0  <  C(u>)  <1.  If  we  define 

B1(u,  t)  =  (l  -  C(U>))a  (W,  t)  +  C(W)A2(W,  t) 

and 

b2(w,  t)  =  C(o))A1(u),  t)  +  (l  -  c(w))a2(u,  t)  , 
then  and  B2  are  both  in  A^d)  and 

+  B2)  =  -*-(A  +  A2)  . 

However,  B  and  B„  cannot  be  represented  as  a  convex  combination  of  A  and 
X  ^  X 

A2  over  the  nonnegative  reals,  and  that  contradiction  completes  the  proof.  [] 
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4 .  Compactness  of  A^ (1)  .  In  this  section  we  deal  with  problems  qualitatively 
different  from  the  algebraic  topics  of  Sections  2  and  3.  In  particular,  the 
role  of  a  fixed  initial  distribution  p  means  we  shall  be  dealing  with  one  family 
of  probability  measures  on  (£2  ,  F)  : 

(4.1)  pNA)  =  fp(dx)P*(A)  =  /p  (dx)PX(6~1A)  . 

p 

We  hereafter  write  P  for  PQ  . 

Let  3  denote  the  Borel  sets  on  [0,  °°]  and  let  C  denote  the  set  of  bounded 

_0  —  ,_0 
r  *  B  -  measurable  functions  that  are  continuous  in  t.  We  recall  that  r 

is  separable,  so  that  C  is  generated  by  a  countable  family  of  functions  of  the 

form  Y(u>)  •  f(t),  where  f  is  continuous.  In  fact  we  can  and  frequently  will 

assume  that  f  is  chosen  from  the  countable  family  V  =  {exp(-rt)  :  r  €  Q) ,  where 

Q  denotes  the  set  of  nonnegative  rationals. 

In  £ 1 3  Baxter  and  Chacon  use  C  to  define  a  topology  on  AQ{1)  and  prove 

sequential  compactness  of  AQ(1)  relative  to  it.  This  requires  the  following 

kind  of  convergence. 

(4.2)  Definition.  A  sequence  (A  )  in  A _ ( 1 )  converges  (BC)  to  A  t  A  (1)  if 

-  no  u 

for  all  Z  in  C 

OO  00 

P[  /  Z(w,  t)  A  (w,  dt)]  -*•  P  [/  Z(U),  t)A(U),  t)]. 

0  n  0 

Our  goal  is  to  prove  the  analogous  result  for  A^(l),  but  that  does  not 
seem  possible  without  restrictions  on  the  underlying  process.  Our  approach  is 
to  push  as  far  as  possible  without  additional  assumptions  and  then  to  illustrate 
hypotheses  that  allow  stronger  conclusions.  Here  is  the  general  result. 

(4.3)  Theorem.  Assume  X  is  a  Markov  process  satisfying  the  hypotheses  of 
Section  2  and  let  (A^)  be  a  sequence  in  A^(l).  Then  there  exist  a  countable 
set  H  ,  possibly  empty,  a  subsequence  ^n')  and  A  £  A^(l)  such  that 
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w.  ■ » »  .  ■  „ «  .  *1,  «/•  j  ■>  ■  :  '  vp;.  ■> v  v  v  V  ■  ■  ■  ■  ■  ■  ■  « 


(4.4)  0  A^  ->  OfaA  (BC) 

for  all  b,  except  possibly  for  b  in  the  set  H.  Moreover,  A  is  defined  using 

A  €  A  (1)  having  the  properties:  0  A  £  A  ( 1 )  for  r  in  Q'  =  H  U  5  i  0  A  > 
u  r  0  r  n 


converges  (BC)  to  O^A  for  r  €  Q'  ,  and  if  r  and  s  are  in  Q*  with  r  <  b  <  s, 
then  for  all  t  >  0 

0  A(W,  t)  >  0  A (U),  t)  >  0  A(U),  t)  . 
r  -  b  s 


(We  subsequently  abbreviate  this  as  ©rA  >  0j_A  >  G^A  . ) 

It  is  tempting  to  try  to  combine  A  and  A  into  one  random  measure  in  A^(l) 
satisfying  (4.4)  for  all  b.  Unfortunately  this  does  not  seem  possible  without 
restrictions  on  the  process.  Before  going  into  that  point  further  we  shall 
prove  Theorem  (4.3).  In  doing  so  we  will  obtain  the  following  corollary,  which 
illuminates  the  role  of  the  set  H. 

(4.5)  Corollary.  Suppose  A  has  the  property  that  for  all  nonincreasing  f, 

OO 

P [/  f  (t  +  r) A (0  0),  dt)]  is  continuous  in  r.  Then  H  =  0  ,  and  (4.4)  holds  for  all 
0  r 

b  >  0  .  Q 


The  proof  of  (4.3)  relies  heavily  on  certain  results  from  Baxter  and  Chacon 

[1],  which  we  record  here.  Baxter  and  Chacon  define  a  functional  a  for Y  €  L  (P)  and 
i  1 


f  €  C[0,  °>]  by 

(4.6)  a (Y,  f)  =  P[Y(W)  •  /  f(t)A(W,  dt) ] 

and  establish  that  functionals  of  the  form  (4.6)  are  characterized  by  the  following 
properties 

(4.7a)  a  is  bilinear  and  positive  :  0  <  Y  and  0  <  f  imply  0  <  a(Y,f); 


l 
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(4.7b)  o(l,  1)  =  1  ;  |o(Y,  f)  |  <  j|Y  ||  .  ||  f  |L  ; 

(4.7c)  for  all  b,  supp  (f)  =  support  (f)  ci  [0,  b]  implies  a(Y,  f)  = 
a(P(Y)Fb)  ,  f). 

(we  note  that  to  fulfill  the  first  condition  in  (4.7b)  we  need  to  define 
A(to,  {<»})  as  1  -  A  (to,  °°)  .) 

We  need  two  additional  conditions.  Let  r  >  0  be  fixed. 

(4.7d)  supp(f)  C  [0,r]  implies  ct(Y,  f)  =  0  ; 

(4.7e)  a(Y,  f)  =  a(p(Y|Gr))  ,  where  G^  =  0  ^(F)  . 

(4.8)  Lemma.  A  functional  a  has  the  representation  (4.6)  with  A  =  0  B 
if  and  only  if  (4.7a-e)  hold;  B  is  unique  up  to  P  a.s.  equivalence. 

Proof.  If  A  =  G^B  ,  it  is  easy  to  check  that  the  conditions  in  (4.7)  hold. 
Conversely,  as  in  [1],  (4.7a-c)  produce  A,  and  one  need  only  verify  it  is 
of  the  asserted  form.  Fixing  f  and  defining  Y  as  / fA(to,  dt)  ,  we  can  use 
(4.7e)  to  prove 

P[(y  -  P(YjGr))2J  =  0 

i.e.,  Y  is  G^-measurable.  Repeating  this  for  a  countable  determining  class 
in  C[0,  “>]  gives  existence  of  a  random  measure  B  such  that  A  (to,  dt)  = 

B(0rO),  dt)  almost  surely.  Moreover,  (4.7d)  shows  that  support  of  both 
measures  is  [r,  °°]  a.s.  Redefining  B,  we  have  A  =  G^B.  The  verification  that 
B  is  unique  up  to  a.s.  equivalence  is  then  immediate.  (Actually,  we  have 
uniqueness  with  respect  to  the  measure  on  (ft,  F) . )  Q 

Another  result  from  [1]  that  we  shall  find  useful  is: 

(4.9) .  Let  S  and  T  be  in  7(1)  ,  with  A  and  B  their  corresponding  measures. 
Then  the  following  are  equivalent: 

(i)  S(to,  •)  <  T (to,  •)  a.s.  ; 
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(ii)  A (w,  t)  >  B  (uj ,  t)  a.s.  ; 


(iii)  If  f  is  nonincreasing  on  [0,  00 ]  then 
/ f (t)A(u),  dt)  >  /f(t)B(w,  dt)  a.s. 

Here  is  the  first  step  in  proving  (4.3). 


(4.10)  Proposition.  Given  a  sequence  (A  )  in  A. (1)  ,  there  exist  a  subse- 

- 1 -  n  j. 

auence  (A  ..)  and  random  measures  {b^  :  b  >  o}  such  that: 
n  b  - 


(i)  for  each  b,  0,  A  >.  -*•  0  B  (BC)  ; 

bn  b  b 


(ii)  there  exists  a  set  of  full  measure  such  that 

if  0  <  b  <  c  ,  then  0  B  >  0  B  on  ; 

--  bb-cc  0 


(iii)  except  possibly  for  B  in  a  countable  set  H 


lim  P[Y  -  /  f(t  +  c)B  (9  oi,  dt)]  =  P[Y  •  /  f(t  +  b)B.  (0.W,  dt)  ] 
cHb  C  C  b  b 

for  f  a  continuous  nonincreasing  function  and  Y  >  0  . 


Proof.  Let  Q  denote  the  rationals  as  before  and  select  a  subsequenoe  A  .. 


such  that  for  each  rational  r  ,  0  A  »  converges  (BC)  to  a  limit  random 

r  n 


measure  A  in  A  (1).  Since  (4.7  d,  e)  hold  for  0  A  ,  ,  they  hold  for  A 
r  0  r  n  r 


and  hence  A  is  of  the  form  G  B  .  Thus 
r  r  r 


oo  00 

/  f(t)A  (u,  dt)  =  f  f(t  +  r)B  (0  oi,  dt)  . 
0  r  0  r  r 


Since  A  6  A  (1)  ,  it  follows  that  for  Y  >  0  , 


P  [  Y  •  /  f(t  +  r)A  (0  0),  dt)  ]  >  P(Y  •  /  f  (t  +  s)A  (0  U>,  dt)  ]  , 
0  n  r  0  n  r 


provided  f  is  nonincreasing  and  r  <  s.  For  r  and  s  in  Q  ,  this  inequality 


persists  in  the  limit,  and  we  can  define  a  set  of  full  P-measure  such 
that  (ii)  holds  for  all  b  and  c  in  Q  .  Moreover,  since  q(r)  =  g(r,  Y,  f)  = 
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P[Y  /  f(t  +  r)B  (0  u,  dt) ]  is  monotone  on  Q,  we  can  define  a  countable 
0  r  r 


set  H  such  that  for  b  not  in  II  ,  g  is  continuous  across  b  for  all  Y  and 


f  in  the  family  V  of  functions  f  (t)  =  exp  (  -  rt)  ,  r  £  Q  . 


We  now  extract  a  further  subsequence  so  that  converges  to 


for  r  6  Q'  =  H  U  Q  .  Since  Q*  is  also  countable,  the  preceding 


analysis  applies  to  the  new  measures,  and  we  use  the  same  letters. 


On  ft  we  define  B,  for  all  b  by 
0  b 


CO  00 

/  f(t  +  b)B,  (0.0),  dt)  =  sup  I  f(t  +  s)B  (B  0),  dt) . 
0  b  b  0  s  s 

s  6  Q* 
s  >  b 


Note  that  the  family  {0  B  :  b  >  o)  extends  the  family  with  b  restricted 


to  Q'  and  that  conditions  (ii)  and  (iii)  have  been  established. 


For  condition  (i)  we  observe  that  (BC)  convergence  is  valid  by 


definition  for  b  in  Q'  .  For  b  not  in  Q'  we  have 


OO 

P[Y  •  f  f(t  +  s) B  (0  W,  dt)] 

0  s  s 

00 

<  lira  P  [Y  •  /  f(t  +  b)  A  ^  ( 0wu) ,  dt)  ] 
-  0  n  b 


<  lim  P[Y  •  /”f(t  +  b) A  ^(0,(0,  dt)  ] 
-  0  no 


CO 

<  P [Y  •  f  f(t  +  r) B  (0  0),  dt)] 
0  r  r 


provided  r  <  b  <  s  ,  r  and  s  are  in  Q'  ,  0  <  Y  ,  and  f  nonincreasing. 


Since  b  is  not  in  Q'  ,  we  have  continuity  across  b  for  a  generating  class 


of  C.  Therefore  the  limit  exists  and  can  be  represented  using  0.B 


This  completes  the  proof  of  (4.10).  [] 
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We  are  now  able  to  prove  Theorem  (4.3). 

Proof  of  Theorem  (4.3) :  It  would  be  pleasant  if  we  could  simply  drop  the 

b  as  a  subscript  of  B  and  aver  that  we  had  obtained  the  limit  random  measure. 

Unfortunately,  that  seems  to  be  the  most  difficult  step.  Our  approach  is 

to  define  a  new  initial  measure  p  and  a  limit  distribution  relative  to 
P 

P  .  The  properties  of  p  will  enable  us  to  define  A. 

Let  {g^  :  s  €  Ql  denote  a  countable  family  of  nonnegative,  bounded 
continuous  functions  that  generates  B  ;  then  with  a(s)  and  b(r)  denoting 
positive  normalizing  constants,  we  define 

00  , 

P (dx)  =  £  a(s)  f  g  (b)e  PM (X  e  dx)db 

see  os  b 

+  I  b(r)P^(Xr  G  dx)  . 

r  €  Q' 

Next  apply  Baxter  and  Chacon's  result  to  (A  relative  to  the  measure 

n 

PP  on  (fi,  F)  and  extract  yet  another  subsequence  converging  (BC)  to  a  random 

measure  A  €  AQ(1).  We  then  use  standard  techniques  to  obtain  an  F°-measurable 

random  measure  PP-equivalent  to  A  and  denoted  by  the  same  letter. 

.  .  u 

Now  it  is  clear  that  on  path  space  P  is  absolutely  continuous  with 

respect  to  PP  for  r  £  Q1 .  Hence  there  exists  a  Radon-Nikodym  derivative 

W  such  that 
r 

PM[Y  0  0  •  /  f(t  +  r ) A  -(0  0),  dt)] 

r  n  r 

=  P^fY  •  /  f(t  +  r) A  >■  ( to ,  dt)] 
r  n 

=  PP[Y  *  W  /  f(t  +  r) A  y(u>,  dt)] 
r  n 

-*•  PP[Y  •  Wr  f  f(t  +  r)A(w,  dt)] 

-  P^(Y  •  /  f  (t  +  r)A(u>,  dt)  ]  . 


21 


It  follows  that  on  a  set  of  full  P-measure  we  have  G  B  =  0  A  for  all 

r  r  r 

r  in  Q' .  In  effect  we  can  eliminate  the  subscript  from  B^  for  all  r  £  j'. 
Moreover,  we  can  retain  the  inequalities  O^A  >  O^A  ,  r  <  s  €  Q'  ,  on  this 
set  of  full  measure. 

A  repetition  of  the  argument  using  absolute  continuity  confirms  that 
for  each  s 

°o  _b  00 

/  g  (b)e  p!~[Y  •  f  f(t  +  b)A  *(U),  dt)]db 
0  s  b  o  n 


converges  to  the  same  expression  with  A  replacing  A^,.  .  Indeed  with  our 
usual  Y  >  0  and  f  £  V,  we  can  get  an  upper  bound  for  the  expression  above, 
to  wit 

b  oo 

T.  f  k+1g  (b)e~bp^  [Y  •  /  f(t  +  b.  )A  .(a),  dt)  ]db 
k  b  s  bw  0  k  n 

k  K 

and  a  lower  bound  of  the  same  form  but  using  b^^  in  place  of  b^  inside  the  integral. 
If  the  b^  are  restricted  to  Q' ,  we  can  pass  to  tne  limit  and  express  the  upper  and 

lower  bounds  using  B  and  B  as  the  random  measures.  Finally,  assume 

k  bk+l 

the  mesh  size  of  the  partition  is  taken  smaller  and  use  countability  of 
the  set  of  discontinuity  points  to  obtain 


(4.11) 


f  g  (b)e  PjY  -  /  f(t  +  b)B,  (to ,  dt)]db 


=  /  g  (b)e'  PHY  *  /  f(t  +  b)A(W,  dt)]db. 

O  S  b  o 

_0  r0 
Since  A  was  chosen  r  -measurable,  it  follows  that  for  Y  r  -measurable 


the  function  G(co,  b)  defined  as  Y (to)  •  /  f(t  +  b)A(io,  dt)  if  F  x  B-measurable. 

0 


By  assumptions  on  the  (PX)  ,  that  means  PX  [G  (u* ,  b)  J  is  F°  x  g- 


measurable 


2  2 


[G«o*  ,b)  ]  ]  . 


and  Fubini’s  theorem  than  gives  the  8-measurability  of  Py[PX^b'W^ 

We  can  argue  that  the  corresponding  expression  with  B,  in  place  of 

b 

A  is  also  8-measurable ,  since  it  is  the  limit  of  B-measurable  functions. 

It  then  follows  that  (4.11)  holds  for  all  Borel  measurable  g,  as  well  as 

the  g  ,  from  which  we  can  conclude  that  for  all  b  except  those  in  a  real 
s 

null  set, 

CO  00 

PJ*[Y  *  /  f(t  +  b)B.  (to,  dt)]  =  P^[Y  •  /  f(t  +  b)A(to,  dt)]. 

b  o  b  b  0 

Hence,  except  for  b  in  a  null  set 

O  b  =  0,  A  ,  a.s.  P^. 
b  b  b 

Again  by  Fubini’s  theorem,  on  a  set  of  full  P^-measure  0.B,  =  0,  A  ,  except 

b  b  b 

for  a  real  null  set  depending  on  to.  But  this  means  that  if  we  use  the 
concept  of  essential  limits  -  that  is,  with  respect  to  a  topology  on  [0,  °°] 
in  which  open  sets  are  Borel  open  sets  minus  a  set  of  Lebesgue  measure 
zero  -  we  can  define  a  random  measure  A  by 

CO  CO 

(4.12)  /  f  (t)  A  (to,  dt)  =  ess  lim  /  f  (t  +  b)A(0  to,  dt)  , 

0  b+0  0  b 

for  f  nonnegative,  nonincreasing  and  continuous.  Note  that  the  monotonicity 

property  of  0^8^  and  its  a.s.  equivalence  to  0^_A  also  give 


OO 


/  f  (t)  A  (to,  dt) 
0 


lim 

b+10 


/ 

0 


f  (t  +  b)  B  (9  B,  dt) . 
b  b 


The  key  feature  of  (4.12)  is  that  we  obtain  the  same  random  measure 

A  (to * ,  dt)  for  all  to'  of  the  form  (o’  =  0.  to,  =  0.  (0_  ,  where  to.  and  (0_ 

b^  1  b^  2  1  2 

lie  in  the  set  of  full  measure  defined  in  the  preceding  paragraph.  This 


is  because  we  can  use  A(0,(o',  •)  =  AO,  ,  w,  •)  =  A(0,  to,  •)  in 


the  limit  and  need  not  worry  about  accumulation  of  null  sets  that  would 
result  were  we  to  try  to  use  directly  in  (4.12). 

Those  unfamiliar  with  the  concepts  used  in  (4.12)  can  refer  to  Walsh  [15], 
in  which  these  topics  are  described  and  from  which  the  F-measurability 
of  A  follows.  Since  =  O^A  on  a  set  of  full  measure,  the  inequalities 

asserted  in  (4.3)  have  been  established,  and  at  times  b  not  in  H  the  conver¬ 
gence  of  O^A^.-  to  is  immediate.  We  have  thus  devised  a  way  to  "drop 

the  subscripts  from  B^"  -  at  least  to  the  point  of  reducing  the  statement 
to  two  limit  measures  A  and  A.  That  is  enough  for  (4.3)  and  completes  the 
proof  of  the  theorem.  [] 

Without  additional  restrictions  on  the  process  we  cannot  eliminate 
the  need  for  two  random  measures  in  the  statement  of  (4.3).  In  view  of 
the  generality  in  which  the  theorem  is  formulated,  that  is  not  entirely 
unexpected,  but  neither  is  it  entirely  satisfactory.  The  difficulty  is 
that  in  regularizing  A  to  get  A  €  A  (1) ,  we  imposed  a  type  of  right-continuity 
not  required  for  A^(l).  The  effect  is  that  we  cannot  assert  that  (A^..) 
converges  to  A  even  though  we  do  know  (A^)  converges  to  A. 

As  an  example,  let  X  be  uniform  motion  to  the  right  on  the  line  and 

let  A^  correspond  to  the  first  hit  of  {l/n}  U [1,  °°) .  Then  A  evidently 

corresponds  to  the  first  hit  of  {o}  U  [1,  00 ) ;  in  particular  if  Xq(w)  = 

0,  A (co ,  •)  puts  all  its  weight  at  {o}.  However,  for  that  same  W,  A(w,  •) 

corresponds  to  the  first  hit  of  [1,  00 )  and  thus  is  not  the  limit  of  the 

A  . 
n 

There  are  a  variety  of  assumptions  restricting  either  the  process 
X  or  the  sequence  (A^)  that  enable  us  to  make  sharper  assertions.  The 
first  is  motivated  by  the  counterexample  above. 
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(i)  Uniformity  of  convergence  of  right-continuous  A^.  Without  loss 
of  generality,  replace  the  subsequence  (A^-)  by  the  original  sequence. 

Let  2^  stand  for  Y(co)  •  f(t  +  r)  for  our  usual  Y  and  f  and  use  (Z^  ,  O^A) 
to  denote 

00 

pp[/  z  (a),  t) a (0  w,  at)], 
o  r  r 

We  make  two  assumptions: 

(4.13a)  for  all  sufficiently  large  n,  lim  (Z  ,  0  A  )  =  (Z  ,  A  )  . 

^  r  r  n  n 

r-K) 

(4.13b)  for  each  such  Z  there  is  a  6  >  0  such  that 

lim  sup  |  (Z  /  0  A  )  -  (Z  ,  0  A) I  =  0. 
n-x»  r€Q,r<6  n  r 

It  follows  from  (4.13)  that  (A  )  converges  to  A.  To  see  this  fix 

n 

Z  and  the  6  guaranteed  by  (4.13b).  Then 

|(Z,  A)  -  (Z,  A) |  <  | (Z,  A)  -  (Zr  ,  0rA)| 

+  |  (2  ,  0  A)  -  (Z  ,  0  A  )  |  +  |  (Z  ,  G  A  )  -  (Z  ,  A  )  | 

1  r  r  r  r  n  1  1  r  r  n  n  1 

+  |  (2  ,  An)  -  (Z  ,  A)  j  . 

The  fourth  term  on  the  right  can  be  made  small  for  large  n,  as  can  the 

second  term  uniformly  in  r  <  5  ,  by  virtue  of  (4.13b).  Fixing  such  an  n, 

we  can  then  make  the  first  and  third  terms  small  by  choosing  small  r. 

Hence  (Z  ,  A)  =  (Z  ,  A)  for  a  generating  class  of  Z,  which  verifies  the 
assertion. 

(ii)  Markov  chains  with  countable,  stable  states.  The  conditions 
in  (4.13)  hold  in  this  case,  so  that  A^(l)  is  sequentially  compact. 

(iii)  Discrete  time  Markov  processes.  In  this  case  there  is  no  difficulty 
with  null  sets  accumulating,  and  the  Baxter-Chacon  argument  easily  gives 
sequential  compactness  of  A^(l). 
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(iv)  Domination  of  the  transition  probabilities.  (We  are  indebted 
to  J.  Glover  for  suggesting  this  condition.) 

(4.14)  Proposition.  Suppose  r)  is  a  measure  an  S  such  that 

PM(Xb  6  •)  <  <n(-) 

for  all  b  >  0.  Then  A^(l)  is  sequentially  compact. 

Proof.  It  is  easy  to  use  an  absolute  continuity  argument  to  show  that 
for  all  b  6  Q'  ,  0^A  =  0^A  almost  surely.  Hence  0faA  works  as  the  limit 
measure  for  all  b  and  the  almost  sure  inequalities  defining  A^(l)  follow 
immediately.  [] 

5.  Applications.  As  noted  in  the  introduction,  motivation  for  studying 
structural  properties  of  randomized  times  arose  from  problems  concerning 
transient  Markov  processes.  In  this  section  we  consider  three  applications 
of  the  material  from  the  preceding  sections.  In  the  first  we  use  a  modi¬ 
fication  of  the  remplissage  (filling)  scheme  to  give  an  explicit  construction 
of  a  randomized  terminal  time  that  realizes  (1.1),  thereby  solving  in 
T2(l)  Skorokhod's  problem  for  finite  state  Markov  chains.  In  the  second 
application  we  pursue  an  analogous  example  for  a  transient  Markov  chain 
with  countable  state  space  and  see  how  (4.13)  can  be  applied.  The  third 
application  concerns  Rost's  original  work  [12]  and  illustrates  how  the 
class  of  randomized  times  could  be  narrowed  in  his  context. 

We  begin  by  assuming  X  is  a  Markov  chain  with  a  countable  state  space 
S.  Let  A  be  a  finite  subset  of  S  and  y  a  fixed  probability  with  support 
in  A.  Define  by  M(y)  the  set  of  probabilities  r|  with  support  in  A  and  such 
that 

(5.1)  / fdn  <  / fdy 
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for  all  f  €  E  ,  the  cone  of  bounded  excessive  functions.  (The  integral 
in  this  context  is  just  a  finite  sum,  but  in  subsequent  discussions  we 
shall  interpret  (5.1)  as  an  integral  over  a  more  general  space.) 

We  have  the  following  result. 

(5.2)  Theorem.  For  each  r|  in  M(y)  there  exist  an  integer  N  <  card  (supp  (n) ) 

N 

a  set  of  positive  reals  ls^  :  1  <  i  <  n}  with  E  s^  =  1  and  a  strictly 
decreasing  family  {a^  :  1  <  i  <  n}  of  subsets  of  supp(T))  such  that: 

(a)  Py(D.  <  °°)  =  1  ,  1  <  i  <  N  ,  where  D.  =  inf{n  >  0:  X  €  A.  }, 

i  -  “  x  n  x 

and  A^  =  supp  (n)  ; 

(b)  n(x)  =  }  py(x(T  )  =  x)du  , 

0  u  ' 

where  T  is  the  randomized  terminal  time 

T(u),  u)  =  D  (ui)  ,  u.  <  u  <  u  , 

1  i-  1  -  i 

i 

with  u.  =  0  and  u .  =  E  s .  . 

0  i  i  J 

Proof.  In  the  filling  scheme  cited  above  one  fills  in  the  measure  ri  step 
by  step,  with  each  step  corresponding  to  one  time  unit.  In  our  approach 
each  step  corresponds  to  one  hitting  time.  Specifically,  let  yQ  =  V*  , 

=  T)  and  A^  =  supp  (n^)  .  Since  the  function  f  (x)  =  P  (D^  <  °°)  is  excessive, 
(5.1)  gives 

PW0(Di  <  oo)  =  /f  du  >  /f  dTij  =  Pni(D1  <  »)  =  1  . 

Thus  the  measure  y^  (x)  =  Py0(x(Dj.)  =  x)  is  a  probability  with  supp(y^)  C 
supp(n^).  If  V1  =  r\1  we  are  done.  Otherwise  define 


t  =  max{t  :  ry  -  ty,  >  o} 


n2  “  (1  tr  (ni  ~  Vi5, 

and  let  A 2  =  supp(n2)  c;  A^  .  To  see  that  f|2  £  M(p^),  suppose  f  g  E  and 
define  its  reduite 


rxf (x)  =  PX[f(x{D1))  ;  D1  <  •]. 


The  function  r^f  is  excessive,  and  r^f  <  f  ,  with  equality  on  A^  .  Hence 


f£dr\1  =  /r1fdri1  <  /r^dUg  =  /fd^  . 


tt  follows  that 


/fdn2  =  (1  -  t1)"1[/fdn1  -  t1/fdv0i  <  ffar)x  <  /fdUj,  . 

confirming  p2  €  M(y^).  Setting  A2  =  supp(ri2),  the  function  f(x)  =  pX[D2  <  °°1 


is  excessive,  and 


pu°(d2  <  ~)  =  pPi(d2  <<*>)=  ffavl  >  /fdn2  =  1  . 

Proceeding  recursively,  define  y5(x)  =  P^°(x(D^)  -  x)  .  If  p2  =  r)2  » 


we  have 


(x)  =  t^OfXCD^  =  x]  +  (1  -  t1)PVJ°tX(D2)  =  x] 
and  need  only  set  N  =  2  ,  s^  =  t^  and  s2  =  1  -  t^  to  complete  the  proof. 


Otherwise,  we  define 


t2  =  max{t  :  n2  -  ty2  >  o) , 


n3  =  a  -  t2)  (n2  -  t2y2). 


and  set  A3  =  supp(n2)  c  A2  .  We  then  repeat  the  argument  of  the  preceding 
paragraph . 

Since  the  sets  A^  are  strictly  decreasing  this  procedure  ends  after 
it  most  card  (supp(n))  steps,  and  the  constants  can  be  identified  as  s^  =  t^ 


»nd  s.  =  fll  (l-t.)Jt.  ,  2<i<N  ,  where  N  is  the  number  of  steps.  [] 


Remplissage  with  hitting  times  also  applies  in  the  finite  state 

case  even  when  (5.1)  fails.  One  proceeds  in  the  same  fashion,  but  since 

=  o°  is  possible,  the  may  be  sub-probability  measures,  the  may 

have  mass  greater  than  1  and  the  t^  must  be  constrained  not  to  exceed 

one  -  all  of  this  in  order  to  account  for  mass  that  "escapes." 

(5.3)  Theorem.  Let  y  and  T}  be  probability  measures  on  the  finite  set 

A  and  assume  A  is  transient  for  the  process.  Then  there  exist  an  integer 

N  >  0  ,  strictly  decreasing  subsets  {a^  :  1  <  i  <  N+l}  and  positive  constants 

s.  ,  1  <  i  <  N  such  that  Is.  =1  and 
l  a 

N  u 

n(x)  =  I  siPH[x(Di)  =  x]  +  (n  -  u)hn+1(x)  , 

i_i 

where  hn+i(x'  y)  =  pX[x(Vi)  =  y  '  °N+1  <  ”]  • 

Proof.  One  proceeds  as  in  (5.2),  stopping  at  stage  N  if  either  p„  *  H„ 

— - -  N  N 

or  t.  >  1  .  In  the  first  case  we  have  (5.2).  In  the  second  case,  the 
N  - 

s.  are  defined  as  before  and 

i 
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N-l 

/fdn„  =  f  fdn  ~  1  si  *  fd^i  "  ^fd^N  +  (1  ~  S  }/fdu  . 

an  i=1  an 

Since  f  equals  its  reduite  r  f  on  h  ,  we  can  replace  f  by  r  f  above  to 

N  N  N 

obtain 

N-l 

/f<Ho  = 

(Recall  that  /fdu  =  /r  fdy.)  The  integrals  in  the  summation  have  the 
N  N 

form  /fdy  ,  yielding  the  last  step: 

/fdn^  =  /rNfd(n  -  y)  =  /fd(nN  ~  • 

It  follows  that  T)^  and  nN  -  yN  have  the  same  potential  and  are  thus  equal. 
It  is  then  easy  to  show  that  ~  =  nN+1  “  UN+1  *  where  \+l  -  supper^) 
and  this  completes  the  proof.  £] 

Note  that  the  procedure  always  terminates  in  a  finite  number  of  steps 
This  contrasts  with  the  time-step  method  of  remplissage,  which  may  require 
infinitely  many  steps.  However,  it  is  easy  to  construct  examples  which 
show  the  approach  used  here  is  generally  applicable  only  in  the  finite 
state  case.  In  fact  these  examples  motivate  Theorem  (4.3),  which  would 
allow  us  to  use  a  limiting  process  to  define  an  appropriate  randomized 
quasi-terminal  time,  at  least  in  the  Markov  chain  case. 

Thus,  for  our  second  application  we  assume  X  is  a  transient  Markov 
chain  on  a  countable  state  space,  y  and  r)  are  measures  satisfying  (5.1) 
on  this  countable  set,  and  we  replace  the  assumption  of  finite  support 
for  y  and  ri  by  the  assumption  that  supp(r;)  is  a  transient  set.  Under 
these  hypotheses,  (5.1)  is  equivalent  to  yG(x)  >  r)G(x)  for  all  x  6  S, 
where  G  is  the  potential  matrix. 


/  r  fd(u  -  y)  -  £  s.  /  r  fdy  +  (1  -  s  )/fdy  . 

„  N  .  ,  1  „  N  1  N  N 

\  1=1  \ 


Define  T(C)  as  inf{n  >  1  :  X  6  c}  ,  D(C)  as  inf{n  >  0  :  X  €  c}  , 

n  -  n 

=  T (supp (n) )  ,  and  =  D(supp(n)).  Then  BQ  =  {x  :  PX(T^  <  °°)  <  l} 

cannot  be  empty.  In  fact,  since  P^fD^  <  °°I  =  1  by  (5.1),  we  have  a  more 
precise  result. 

(5.4)  Lemma.  If  (5.1)  holds,  then  Py(D(BQ)  <  «)  =  pn(D(B0)  <  °°)  =  1  .  Q 
We  then  have  the  following. 

(5.5)  Theorem.  Suppose  p  and  f)  satisfy  (5.1)  and  supp(T))  is  transient. 

Then  there  exists  a  randomized  quasi-terminal  time  T  such  that  for  all 

x  £  S 

r)(x)  =  f1  PWfx(T  )  =  x)du  . 

0  u 

Proof.  Let  be  a  finite  subset  of  supp(ri)  -  Bq  and  let  A^  =  J  . 

Using  the  reduite  as  before  it  is  easy  to  show  that  p^  dominates  in 

the  potential  ordering,  where  p.^  and  Uj  are  the  balayages  of  p  and  f|  onto 
A^  .  By  (5.4),  D(A^)  <  00  a.s.  P^  and  ,  so  that  p^  and  are  probabilities. 

We  will  now  show  that  the  recursive  procedure  in  Theorem  (5.2)  works 
in  this  context  as  well.  In  fact,  inspection  of  that  procedure  shows  we 

need  only  verify  p^ (x)  <  n  (x)  for  all  x  £  BQ  .  That  being  so,  the  set 

Bq  will  be  carried  intact  in  the  iteration,  and  the  same  proof  applies. 

Define,  then, 

G1  =  {x  £  BQ  ,  Px(x)  >  ri^x)}, 

G2  =  {x  e  Bq  ,  Px(x)  <  ^(x)}, 

and 

f  (x)  =  px{d(c1  j  g2)  <  <»)  . 


31 


Then  f  is  excessive,  /fdn^  <  /fdy^  ,  and  from  that  we  can  obtain 


/  (1  -  f)dp1  <  /  (1  -  fjdr^ 


Since  y^(x)  >  f|^  (x)  on  G^  ,  on  we  have 


f  (x)  =  PX(t(C1  U  G2)  <  «)  =  1 


But  for  all  x  €  B  ,  P  (T  <  °°)  <  1  by  definition,  which  leads  us  to 
0  nl 

conclude  that  G^  is  empty,  and  y^ (x)  <  (x)  everywhere  on  BQ  . 

We  now  proceed  as  follows.  Let  (Cn  :  n  >  1)  be  an  increasing  sequence 

of  sets  converging  to  supp(n)  -  B^  ,  let  T)n  be  the  balayage  of  n  onto 

C  U  B„  ,  and  let  T  be  the  randomized  terminal  times  constructed  in 
no  n 


Theorem  (5.2) j 
(5.6) 


(x)  =  /  py[x(T  (u))  =  x]du 


=  I  PUn[x(T  (u)  =  x) ]du  =  n  (x)  , 

0  n  n 

where  is  the  balayage  of  y  onto  Cn  'J  BQ  .  Condition  (iii)  at  the  end 

of  Section  4  applies,  so  we  can  extract  a  subsequence  converging  (BC) 
to  a  randomized  quasi-terminal  time  T  such  that  r|G(x)  >  P^G(x)  >  rinG(x) 

for  all  n.  S  nee  (y)  >  rj  (y)  on  U  BQ  ,  it  follows  that  r|G  =  P^G  , 


and  that  forces  n  to  equal  P^  .  [] 


We  have  relied  upen  the  assumption  that  time  and  state  space  are 


countable,  and  it  is  reasonable  to  ask  whether  this  assumption  is  indispensable 


In  fact  it  is  not,  and  we  shall  indicate  how  Rost's  original  proof  remains 


valid  with  times  restricted  to  T^(l)  ,  at  least  under  the  assumption  of 

(4.14).  The  first  thing  to  record  is  Meyer's  observation  that  Baxter  and 

Chacon's  work  can  be  extended.  For  the  details  we  refer  the  reader  to 

[11]  and  content  ourselves  here  with  stating  the  relevant  result. 

(5.7)  Theorem.  Suppose  X  is  a  standard,  transient  Markov  process  with 

potential  kernel  G.  Then  if  (A  )  converges  (BC)  to  A,  for  any  bounded 

n 

S-measurable  function  f 

CO  GO 

Py[/  Gf  (X  )  A  (W,  dt)]  -*•  Py[/  Gf(XjA(w,  dt)].  0 

0  t  n  o  t 

Now  suppose  X  is  a  standard,  transient  Markov  process  on  (S  ,  S) 
and  that  y  and  y  satisfy  (1.1)  in  that  context.  Rost  [12]  approaches 
the  problem  of  finding  an  S  in  T  (1)  such  that  n  =  P^  by  first  obtaining 

U  b 

a  "maximal"  S  such  that  P^  dominates  n  in  the  potential  ordering.  That 

b 

argument  can  be  carried  over  to  7^(1}  by  using  sequential  compactness, 
at  least  in  the  context  of  Proposition  (4.14).  The  next  step  is  to  use 

.  y 

the  potentials  P  G  and  nG  to  construct  a  certain  nonrandomized,  terminal 

b 

time  T  that  is  conjoined  with  S  to  form  s”  =  0  T  .  With  the  sort  of  algebraic 
structure  introduced  in  Section  3,  Rost  shows  a  convex  combination  of 
S  and  S'  also  dominates  n  and  thus  by  maximality  P^[T  =  0]  =  1.  The  form 
of  T  coupled  with  an  extension  of  Hunt's  domination  principle  forces 
equality  of  P^G  and  HG  ,  completing  the  proof. 

If  one  could  show  S'  was  also  in  T^(l)  ,  then  the  same  arguments 
Rost  used  would  apply,  and  we  could  assert  that  there  is  an  S  in  T^(l) 
such  that  n  =  Pg  ,  at  least  in  the  context  of  (4.14).  We  conclude  by 
stating  the  missing  fact  as  a  lemma,  omitting  the  proof,  which  is  merely 
a  matter  of  tracing  out  the  definition. 
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